Systematic Heuristic Evaluation of Computerized Consultation Order Templates: Clinicians’ and Human Factors Engineers’ Perspectives

We assessed the usability of consultation order templates and identified problems to prioritize in design efforts for improving referral communication. With a sample of 26 consultation order templates, three evaluators performed a usability heuristic evaluation. The evaluation used 14 domain-independent heuristics and the following three supplemental references: 1 new domain-specific heuristic, 6 usability goals, and coded clinicians’ statements regarding ease of use for 10 sampled templates. Evaluators found 201 violations, a mean of 7.7 violations per template. Minor violations outnumbered major violations almost twofold, 115 (57%) to 62 (31%). Approximately 68% of violations were linked to 5 heuristics: aesthetic and minimalist design (17%), error prevention (16%), consistency and standards (14%), recognition rather than recall (11%), and meet referrers’ information needs (10%). Severe violations were attributed mostly to meet referrers’ information needs and recognition rather than recall. Recorded violations yielded potential negative consequences for efficiency, effectiveness, safety, learnability, and utility. Evaluators and clinicians demonstrated 80% agreement in usability assessment. Based on frequency and severity of usability heuristic violations, the consultation order templates reviewed may impede clinical efficiency and risk patient safety. Results support the following design considerations: communicate consultants’ requirements, facilitate information seeking, and support communication. While the most frequent heuristic violations involved interaction design and presentation, the most severe violations lacked information desired by referring clinicians. Violations related to templates’ inability to support referring clinicians’ information needs had the greatest potential negative impact on efficiency and safety usability goals. Heuristics should be prioritized in future design efforts

Faculty perceptions of a tobacco cessation train-the-trainer workshop and experiences with implementation: A qualitative follow-up study

Background Between 2003 and 2005, pharmacy faculty members (n = 191) participated in a national train-the-trainer workshop designed to equip faculty with the necessary knowledge and skills to implement a shared curriculum, Rx for Change: Clinician-Assisted Tobacco Cessation, at pharmacy schools across the United States. Objective To conduct a long-term, qualitative follow-up study of faculty participants to describe (a) perceptions of the train-the-trainer workshop, and (b) subsequent experiences with curricular implementation. Results of this investigation will inform a national survey of all train-the-trainer participants. Methods Participants were selected via random sampling from the group of 191 faculty members who participated in the workshop. Semi-structured telephone interviews with participants were audio-recorded and transcribed, and qualitative thematic analysis was conducted. Results Eighteen (62%) of 29 invited individuals participated in the interviews. All participants reported implementing components of Rx for Change at their institution. The analysis yielded eight major themes pertaining to faculty perceptions and experiences with implementation: (1) accessibility to tools for teaching, (2) increased confidence and skills, (3) flexibility delivering the curriculum, (4) factors facilitating implementation and challenges encountered by faculty, (5) enhancement in treating tobacco users in clinical practice, (6) students' confidence and cognizance of the pharmacists' role as a public health advocate, (7) networking and career development opportunities, and (8) useful background for research. Conclusion Participation in the train-the-trainer workshop increased self-reported confidence for teaching tobacco cessation, and faculty valued access to useful, updated tools for teaching. Furthermore, their newly acquired counseling skills were deemed helpful for treating patients' tobacco use and dependence in clinical practice. Participants also perceived improved pharmacy students' confidence and beneficial networking opportunities. Results can help future trainers understand faculty experiences with implementing a shared, national curriculum and inform faculty participants of some of the potential long-term outcomes as a result of participation

Medication decision-making for patients with renal insufficiency in inpatient and outpatient care at a US Veterans Affairs Medical Centre: a qualitative, cognitive task analysis.

BackgroundMany studies identify factors that contribute to renal prescribing errors, but few examine how healthcare professionals (HCPs) detect and recover from an error or potential patient safety concern. Knowledge of this information could inform advanced error detection systems and decision support tools that help prevent prescribing errors.ObjectiveTo examine the cognitive strategies that HCPs used to recognise and manage medication-related problems for patients with renal insufficiency.DesignHCPs submitted documentation about medication-related incidents. We then conducted cognitive task analysis interviews. Qualitative data were analysed inductively.SettingInpatient and outpatient facilities at a major US Veterans Affairs Medical Centre.ParticipantsPhysicians, nurses and pharmacists who took action to prevent or resolve a renal-drug problem in patients with renal insufficiency.OutcomesEmergent themes from interviews, as related to recognition of renal-drug problems and decision-making processes.ResultsWe interviewed 20 HCPs. Results yielded a descriptive model of the decision-making process, comprised of three main stages: detect, gather information and act. These stages often followed a cyclical path due largely to the gradual decline of patients' renal function. Most HCPs relied on being vigilant to detect patients' renal-drug problems rather than relying on systems to detect unanticipated cues. At each stage, HCPs relied on different cognitive cues depending on medication type: for renally eliminated medications, HCPs focused on gathering renal dosing guidelines, while for nephrotoxic medications, HCPs investigated the need for particular medication therapy, and if warranted, safer alternatives.ConclusionsOur model is useful for trainees so they can gain familiarity with managing renal-drug problems. Based on findings, improvements are warranted for three aspects of healthcare systems: (1) supporting the cyclical nature of renal-drug problem management via longitudinal tracking mechanisms, (2) providing tools to alleviate HCPs' heavy reliance on vigilance and (3) supporting HCPs' different decision-making needs for renally eliminated versus nephrotoxic medications

Utilizing a user-centered approach to develop and assess pharmacogenomic clinical decision support for thiopurine methyltransferase

BACKGROUND: A pharmacogenomic clinical decision support tool (PGx-CDS) for thiopurine medications can help physicians incorporate pharmacogenomic results into prescribing decisions by providing up-to-date, real-time decision support. However, the PGx-CDS user interface may introduce errors and promote alert fatigue. The objective of this study was to develop and evaluate a prototype of a PGx-CDS user interface for thiopurine medications with user-centered design methods. METHODS: This study had two phases: In phase I, we conducted qualitative interviews to assess providers' information needs. Interview transcripts were analyzed through a combination of inductive and deductive qualitative analysis to develop design requirements for a PGx-CDS user interface. Using these requirements, we developed a user interface prototype and evaluated its usability (phase II). RESULTS: In total, 14 providers participated: 10 were interviewed in phase I, and seven providers completed usability testing in phase II (3 providers participated in both phases). Most (90%) participants were interested in PGx-CDS systems to help improve medication efficacy and patient safety. Interviews yielded 11 themes sorted into two main categories: 1) health care providers' views on PGx-CDS and 2) important design features for PGx-CDS. We organized these findings into guidance for PGx-CDS content and display. Usability testing of the PGx-CDS prototype showed high provider satisfaction. CONCLUSION: This is one of the first studies to utilize a user-centered design approach to develop and assess a PGx-CDS interface prototype for Thiopurine Methyltransferase (TPMT). This study provides guidance for the development of a PGx-CDS, and particularly for biomarkers such as TPMT

Reducing prescribing errors through creatinine clearance alert redesign

Background Literature has shown that computerized creatinine clearance alerts reduce errors during prescribing, and applying human factors principles may further reduce errors. Our objective was to apply human factors principles to creatinine clearance alert design and assess whether the redesigned alerts increase usability and reduce prescribing errors compared with the original alerts. Methods Twenty Veterans Affairs (VA) outpatient providers (14 physicians, 2 nurse practitioners, and 4 clinical pharmacists) completed 2 usability sessions in a counterbalanced study to evaluate original and redesigned alerts. Each session consisted of fictional patient scenarios with 3 medications that warranted prescribing changes because of renal impairment, each associated with creatinine clearance alerts. Quantitative and qualitative data were collected to assess alert usability and the occurrence of prescribing errors. Results There were 43% fewer prescribing errors with the redesigned alerts compared with the original alerts (P = .001). Compared with the original alerts, redesigned alerts significantly reduced prescribing errors for allopurinol and ibuprofen (85% vs 40% and 65% vs 25%, P = .012 and P = .008, respectively), but not for spironolactone (85% vs 65%). Nine providers (45%) voiced confusion about why the alert was appearing when they encountered the original alert design. When laboratory links were presented on the redesigned alert, laboratory information was accessed 3.5 times more frequently. Conclusions Although prescribing errors were high with both alert designs, the redesigned alerts significantly improved prescribing outcomes. This investigation provides some of the first evidence on how alerts may be designed to support safer prescribing for patients with renal impairment

Crossing the Communication Chasm: Challenges and Opportunities in Transitions of Care from the Hospital to the Primary Care Clinic

Background Transitions of care from specialty and acute settings to primary care abound. Compared to the continuity in end-of-shift handoffs, care transitions involve provider communication between practices and facilities with their own cultures and bureaucracies. Using the transition from acute care to outpatient primary care for stroke/transient ischemic attack (TIA) patients as a case study, this qualitative research explored communication practices and institutional arrangements among clinical providers responsible for longitudinal management of hypertension. In this study, researchers investigated the barriers and facilitators of effective communication between acute stroke/TIA inpatient and primary care providers at a Veterans Affairs Medical Center. Methods A multidisciplinary team conducted consensus-based coding and thematic analysis of semistructured interviews with 21 clinical providers (9 with primary responsibilities for inpatient care and 12 with primary responsibilities in outpatient, primary care). Results Thematic analysis of responses identified three factors that influenced communication between clinical providers: (1) consistent, concise but complete medication and treatment plans; (2) reliable, standardized discharge documentation; (3) use of multiple modes of communication. Participants identified cultural barriers, including challenges with rotating providers at a teaching hospital and local discharge practices. Conclusion Ambiguity about who is being handed off to and time pressures in the acute setting may lead inpatient providers to give lower priority to discharge communication, leaving outpatient providers with low-quality information. While electronic templates have standardized key components of discharge documentation, improvement opportunities remain. Increased awareness of the challenges and opportunities on each side of the care transfer could foster communication practices that systematically account for the information needs of inpatient and outpatient providers

Paper Persistence and Computer-based Workarounds with the Electronic Health Record in Primary Care

With the United States national goal and incentive program to transition from paper to electronic health records (EHRs), healthcare organizations are increasingly implementing EHRs and other related health information technology (IT). However, in institutions which have long adopted these computerized systems, such as the Veterans Health Administration, healthcare workers continue to rely on paper to complete their work. Furthermore, insufficient EHR design also results in computer-based workarounds. Using direct observation with opportunistic interviewing, we investigated the use of paper- and computer-based workarounds to the EHR with a multi-site study of 54 healthcare workers, including primary care providers, nurses, and other healthcare staff. Our analysis revealed several paper- and computer-based workarounds to the VA’s EHR. These workarounds, including clinician-designed information tools, provide evidence for how to enhance the design of the EHR to better support the needs of clinicians

Applying human factors principles to alert design increases efficiency and reduces prescribing errors in a scenario-based simulation

OBJECTIVE: To apply human factors engineering principles to improve alert interface design. We hypothesized that incorporating human factors principles into alerts would improve usability, reduce workload for prescribers, and reduce prescribing errors. MATERIALS AND METHODS: We performed a scenario-based simulation study using a counterbalanced, crossover design with 20 Veterans Affairs prescribers to compare original versus redesigned alerts. We redesigned drug-allergy, drug-drug interaction, and drug-disease alerts based upon human factors principles. We assessed usability (learnability of redesign, efficiency, satisfaction, and usability errors), perceived workload, and prescribing errors. RESULTS: Although prescribers received no training on the design changes, prescribers were able to resolve redesigned alerts more efficiently (median (IQR): 56 (47) s) compared to the original alerts (85 (71) s; p=0.015). In addition, prescribers rated redesigned alerts significantly higher than original alerts across several dimensions of satisfaction. Redesigned alerts led to a modest but significant reduction in workload (p=0.042) and significantly reduced the number of prescribing errors per prescriber (median (range): 2 (1-5) compared to original alerts: 4 (1-7); p=0.024). DISCUSSION: Aspects of the redesigned alerts that likely contributed to better prescribing include design modifications that reduced usability-related errors, providing clinical data closer to the point of decision, and displaying alert text in a tabular format. Displaying alert text in a tabular format may help prescribers extract information quickly and thereby increase responsiveness to alerts. CONCLUSIONS: This simulation study provides evidence that applying human factors design principles to medication alerts can improve usability and prescribing outcomes

Genomic epidemiology of the Escherichia coli O104:H4 outbreaks in Europe, 2011

The degree to which molecular epidemiology reveals information about the sources and transmission patterns of an outbreak depends on the resolution of the technology used and the samples studied. Isolates of Escherichia coli O104:H4 from the outbreak centered in Germany in May–July 2011, and the much smaller outbreak in southwest France in June 2011, were indistinguishable by standard tests. We report a molecular epidemiological analysis using multiplatform whole-genome sequencing and analysis of multiple isolates from the German and French outbreaks. Isolates from the German outbreak showed remarkably little diversity, with only two single nucleotide polymorphisms (SNPs) found in isolates from four individuals. Surprisingly, we found much greater diversity (19 SNPs) in isolates from seven individuals infected in the French outbreak. The German isolates form a clade within the more diverse French outbreak strains. Moreover, five isolates derived from a single infected individual from the French outbreak had extremely limited diversity. The striking difference in diversity between the German and French outbreak samples is consistent with several hypotheses, including a bottleneck that purged diversity in the German isolates, variation in mutation rates in the two E. coli outbreak populations, or uneven distribution of diversity in the seed populations that led to each outbreak